# Data Science

Fin-R1 is a large language model designed specifically for the financial field, aimed at enhancing financial reasoning capabilities. Jointly developed by Shanghai University of Finance and Economics and Caiyue Xingchen, it is fine-tuned and reinforced learning based on Qwen2.5-7B-Instruct, possessing efficient financial reasoning capabilities and is suitable for core financial scenarios such as banking and securities. This model is free and open-source, facilitating user adoption and improvement.

Pruna is a model optimization framework designed for developers. Through a series of compression algorithms, such as quantization, pruning, and compilation, it makes machine learning models faster, smaller, and less computationally expensive during inference. The product is suitable for various model types, including LLMs and vision transformers, and supports multiple platforms such as Linux, MacOS, and Windows. Pruna also offers an enterprise version, Pruna Pro, which unlocks more advanced optimization features and priority support, helping users improve efficiency in practical applications.

This product is an AI-driven data science team model designed to help users speed up their data science tasks. It automates and accelerates data science workflows through a series of specialized data science agents, such as data cleaning, feature engineering, and modeling. The primary advantage of this product is its ability to significantly enhance the efficiency of data science work, reduce manual intervention, and cater to enterprises and research institutions that need to quickly process and analyze large amounts of data. The product is currently in beta, actively under development, and may undergo significant changes. It is licensed under the MIT License, allowing users to use and contribute code for free on GitHub.

vectrix-graphs is a powerful graphical library focusing on the visualization of multi-model embeddings. It supports a variety of machine learning models and data types, presenting complex data structures in an intuitive graphical format. The main advantage of this library lies in its flexibility and extensibility, making it easy to integrate into existing data science workflows. Developed by the vectrix-ai team, this library aims to aid researchers and developers in better understanding and analyzing model embedding results. As an open-source project, it is available for free on GitHub, suitable for projects and teams of all sizes.

Zasper is an integrated development environment (IDE) specially designed for data science, built from the ground up to support large-scale concurrent processing. It features minimal memory usage, exceptional speed, and the ability to handle numerous concurrent connections. Zasper is highly suitable for running REPL-style data applications like Jupyter Notebook. Its main advantages include efficient concurrent processing and lightweight resource consumption, making it of significant value in the data science field. Currently, Zasper is available as an open-source version, ideal for data scientists and developers.

ChatGPT Pro is a subscription product launched by OpenAI at a monthly fee of $200, providing scalable access to OpenAI's most advanced models and tools. The plan includes unlimited access to the OpenAI o1 model, as well as o1-mini, GPT-4o, and advanced voice capabilities. The o1 pro mode is a version of o1 that employs more computational resources to enable deeper thought and provide better answers, particularly when addressing the most challenging problems. ChatGPT Pro is designed to enhance productivity for researchers, engineers, and other individuals who utilize research-level intelligence in their daily work while remaining at the cutting edge of AI advances.

GenCast is a new high-resolution (0.25°) AI ensemble model developed by Google DeepMind that is more accurate than the European Centre for Medium-Range Weather Forecasts (ECMWF) ENS system in predicting daily weather and extreme weather events, providing faster and more accurate forecasts up to 15 days in advance. This model is based on diffusion models and represents a type of generative AI model that has recently made rapid progress in image, video, and music generation. GenCast learns global weather patterns by analyzing historical weather data and can precisely generate complex probability distributions for future weather scenarios. The model's code, weights, and prediction results will be publicly released to support a wider weather forecasting community.

Pyramid Analytics is a business decision intelligence platform that integrates data preparation, business analytics, and data science, helping enterprises achieve fast and effective decision-making. The platform simplifies and guides the use of data in the decision-making process through AI-enhanced analytics, automation, and collaborative insights, lowering skill barriers and accelerating smarter decision integration across organizations. With its intuitive user experience and no-code platform, Pyramid Analytics provides a self-service experience for business users while offering robust management and governance capabilities for enterprises, ensuring that everyone can make decisions without compromise.

Marimo is an open-source reactive Python notebook that emphasizes reproducibility, is git-friendly, can be executed as scripts, and can be shared as applications. It automates the execution of affected cells in response to changes, removing the cumbersome task of managing notebook states. Marimo's UI elements, such as data frame GUIs and charts, make data processing swift, futuristic, and intuitive. Marimo notebooks are stored as .py files, compatible with git version control, executable as Python scripts, importable into other notebooks or Python files, and can be linted or formatted using your preferred tools—all within a modern AI-supported editor.

Graphusion is a pipeline tool designed for extracting knowledge graph triples from text. It builds knowledge graphs through a series of steps, including concept extraction, candidate triple extraction, and triple fusion. This tool is significant as it automates the extraction of structured information from large volumes of text data, supporting knowledge management and data science projects. The main advantages of Graphusion include its automation capabilities, adaptability to different datasets, and flexible configuration options. Developed by tdurieux, the related code and documentation can be found on GitHub. Currently, the tool is free, but the pricing strategy may change based on developer updates and maintenance.

DataChain is a contemporary Python data frame library tailored for artificial intelligence. It is designed to organize unstructured data into datasets and process data at scale on local machines. DataChain does not abstract or hide AI models and API calls but facilitates their integration into modern data stacks. The product's main advantages include its efficiency, ease of use, and powerful data processing capabilities, supporting a variety of data storage and processing methods, including images, videos, text, and more, while seamlessly interfacing with deep learning frameworks like PyTorch and TensorFlow. DataChain is open-source and follows the Apache-2.0 license, making it freely available for users.

awesome-LLM-resources is a platform that aggregates global resources for large language models (LLMs), offering a range of tools and resources from data acquisition and fine-tuning to inference, evaluation, and real-world applications. Its significance lies in providing researchers and developers with a comprehensive resource library to facilitate the efficient development and optimization of their language models. Maintained by Wang Rongsheng, the platform is continuously updated, providing robust support for the advancement of the LLM field.

DeepLearning.AI is an online education platform founded by renowned AI expert Andrew Ng, focused on delivering high-quality courses and professional certificates in machine learning and deep learning. The platform offers beginners and professionals practical opportunities to learn AI skills and apply them. By collaborating with industry leaders, DeepLearning.AI ensures that course content is cutting-edge and practical, helping learners build a solid foundation in AI and advance their careers.

xAI is a company dedicated to building artificial intelligence that accelerates human scientific discovery. Led by Elon Musk, CEO of Tesla and SpaceX, our team has contributed some of the most widely used methods in the field, including the Adam optimizer, batch normalization, layer normalization, and the discovery of adversarial examples. We have further introduced innovative technologies and analyses such as Transformer-XL, Autoformalization, memory transformers, batch size scaling, μTransfer, and SimCLR. We have participated in and led some of the field's most groundbreaking developments, including AlphaStar, AlphaCode, Inception, Minerva, GPT-3.5, and GPT-4. Our team receives consulting from Dan Hendrycks, Director of AI Safety. We work closely with Company X to bring our technology to over 500 million users of application X.

Data-Juicer is a comprehensive multimodal data processing system aimed at delivering higher quality, richer, and more digestible data for large language models (LLMs). It offers a systematic and reusable data processing library, supports collaborative development between data and models, allows rapid iteration through a sandbox lab, and provides features like data and model feedback loops, visualization, and multidimensional automated evaluation, helping users better understand and improve their data and models. Data-Juicer is actively maintained and regularly enhanced with more features, data recipes, and datasets.

UbiOps is an AI infrastructure platform that helps teams run their AI and machine learning workloads as reliable and secure microservices without needing to change their existing workflows. It provides zero-DevOps super-fast pipeline, optimized compute resources, support for LLMs and CV models, and more. UbiOps supports hybrid and multi-cloud workload orchestration, enabling deployment of models in private or public cloud environments, ensuring data and models always stay in the user's environment. In addition, UbiOps also provides built-in security features such as end-to-end encryption, secure data storage, and access control, helping businesses comply with relevant regulations.

LAMDA-TALENT is a comprehensive tabular data analysis toolbox and benchmarking platform that integrates over 20 deep learning methods, 10 traditional methods, and 300+ diverse tabular datasets. This toolbox aims to enhance model performance on tabular data, offers robust preprocessing capabilities, optimizes data learning, and supports user-friendly and adaptable operations suitable for both novice and expert data scientists.

FiddleCube is a product focused on the field of data science. It can quickly generate question-answer pairs from user data to help users evaluate large language models (LLMs). It provides accurate gold-standard datasets, supports various question types, and enables evaluation of data accuracy through metrics. Moreover, FiddleCube offers diagnostic tools to help users identify and improve underperforming queries.

AI Online Course is an interactive learning platform that provides clear and concise introductions to artificial intelligence, making complex concepts easy to understand. It covers topics such as machine learning, deep learning, computer vision, self-driving cars, and chatbots, emphasizing practical applications and technological advancements.

Next AI Jobs is a website that provides job and career opportunities in artificial intelligence, machine learning, natural language processing, and data science. It connects employers and job seekers in the AI industry, offering a wide range of development and career advancement opportunities. The main advantage of Next AI Jobs is its concentration of AI-related jobs and career options, providing job seekers with a more convenient path for professional development.

Dreamseer is an app that utilizes data science to interpret dreams, helping users gain a deeper understanding of themselves and achieve personal growth and evolution. Its core strengths include providing profound insights, fostering community collaboration, and expanding the realm of dream exploration. Dreamseer operates within the spheres of personal development and community engagement.

MyGO is a tool for multimodal knowledge graph completion. It processes discrete modal information as fine-grained labels to enhance completion accuracy. MyGO utilizes the transformers library to embed text labels and trains and evaluates on multimodal datasets. It supports custom datasets and provides training scripts for replicating experimental results.

Google Cloud's Machine Learning Engineer Learning Path is a curated set of online courses and labs designed to equip learners with practical hands-on experience in Google Cloud technologies. It covers key skills in designing, building, deploying, optimizing, running, and maintaining machine learning systems. Upon completion of this learning path, learners can further pursue the Google Cloud Machine Learning Engineer certification, laying a solid foundation for career advancement.

DataCamp is an online learning platform offering courses in data science, AI, and related fields. It provides a hands-on learning experience through interactive exercises and short videos, covering a wide range of topics including Python, R, SQL, ChatGPT, and Power BI. DataCamp also offers certifications and resources for data science career development.

Semantic Space Theory (SST) is the foundation of Hume AI research. It employs computational and data-driven methods to map the full spectrum of human emotions. Through natural data and advanced statistical methods, SST treats emotions as high-dimensional semantic spaces, revealing the complexity and subtle nuances of emotions.

Cleora PRO is a tool that empowers data science teams to create high-quality customer and product embedding vectors without expensive hardware. It represents entities (such as customers, products, stores, accounts, etc.) through embedding vectors, similar to Word2Vec or BERT for text, or CLIP for images. Cleora's embedding vectors are behavioral, representing entities based on their behavioral history, which exists in the form of a large graph. With Cleora PRO, you can build business models like recommendation systems, customer segmentation, propensity prediction, lifecycle value modeling, and churn prediction.

FibonacciKu is a personalized AI learning assistant designed for both teachers and students. It simplifies the learning process, making education more convenient.

MLJAR offers excellent data science tools and learning materials to help users understand and utilize their data. Its features include automated machine learning, transforming notebooks into interactive web applications, generating Python charts using LLMs, building custom SaaS applications, and server and website monitoring. MLJAR's strengths lie in its XAI capabilities, fairness in machine learning, model interpretability, fairness metrics, and its ability to quickly detect anomalies and send timely notifications. In terms of pricing, MLJAR offers various pricing plans and compares algorithms such as decision trees, random forests, Xgboost, LightGBM, and CatBoost. It is positioned as a data science tool.

OpenDoc AI is a tool that empowers everyone with data science capabilities, accelerating analytics, custom AI model building, and workflow automation tenfold. It automates data workflows using generative AI, provides clear AI instructions for company-wide use, transforms data into actionable insights without requiring training or data science expertise, and seamlessly connects to databases and processes various data types. OpenDoc AI is trusted and supported by teams of all sizes, bringing collaborative knowledge experiences to organizations across industries.

Onehouse is a universal data lakehouse offering open storage, continuous data streams, and automatic optimization across table formats, engines, and cloud platforms. Based on Hudi, Delta, and Iceberg, Onehouse is an automated data platform. It supports business intelligence, data science, and AI/ML, providing a unified lakehouse solution. Supporting both streaming and batch processing, Onehouse automatically manages data infrastructure with true openness and interoperability, saving costs and scaling to meet evolving needs. Created by the developers of Apache Hudi, Onehouse boasts high-throughput data stream ingestion, easy-to-change data capture, automated data management, cloud-native tables, and metadata.